A Class of LULU Operators on 
Multi-Dimensional Arrays 



Roumen Anguelov and Inger Plaskitt 

Department of Mathematics and Applied Mathematics 

^ ■ University of Pretoria 

roumen. anguelov@up.ac.za 

(N ! inger. plaskitt@up.ac.za 

o 

Q 



oo 



> 

U 



Abstract 

The LULU operators for sequences are extended to multi-dimensional ar- 
rays via the morphological concept of connection in a way which preserves 
their essential properties, e.g. they are separators and form a four element 
fully ordered semi-group. The power of the operators is demonstrated by 



q \ deriving a total variation preserving discrete pulse decomposition of images. 

Keywords: LULU, connection, separator, discrete pulse transform, total vari- 
I> ' ation. 
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r4 ■ 1 Introduction 

The LULU operators and the associated Discrete Pulse Transform developed 
during the last two decades or so are an important contribution to the theory 
of the nonlinear multi-resolution analysis of sequences. The basics of the 
theory as well as the most significant results until 2005 are published in the 
^ ■ monograph [13J. For more recent developments and applications see [I], [3], 

[Z]) [1]) [H]- Central to the theory is the concept of separator. This concept is 
defined in [13] only for operators on sequences due to the context of the book. 
However, it is meaningful in more general settings. In fact, some of the axioms 
have been used earlier, e.g. see [18] . for functions on arbitrary domains. We 
will give the definition of separator for operators on real functions defined on 
a domain with a group structure. 

Let a Q be an abelian group. Denote by «4(f2) the vector lattice of all real 
functions defined on O with respect to the usual point-wise defined addition, 
scalar multiplication and partial order. For every a G 0, the operator E a : 
A{9) -> A{9) given by 

E a (f)(x) = f(x + a), x£Q, 
is called a shift operator. 
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Definition 1 An operator P : A(Q) — > A(Q) is called a separator if 

(i) P o E a = E a o P, a G ft; 

(ii) P(f + c) = P (/) + c, /, c G .A(S7), c - constant function; 
(Hi) P(af) = aP{f), a £l, a > 0, / G .4(0); 

(iv) P o P = P] (Idempotence) 

(v) (id — P) o (id — P) = id — P. ( Co-idempotence) 

Here id denotes the identity operator and the operator id — P is defined in 
terms of the point- wise linear operations for the operators on A(Q), that is, 
(id — P)(f) = f — P(f). The first two axioms in Definition [1] and partially the 
third one were first introduced as required properties of nonlinear smoothers 
by Mallows, [9]. Rohwer further made the concept of a smoother more precise 
by using the properties (i)-(iii) as a definition of this concept. The axiom 
(iv) is an essential requirement for what is called a morphological filter, [18J, 
|19j . |21j . In fact, a morphological filter is exactly a syntone operator which 
satisfies (iv). Let us recall that an operator P is called syntone if 

/ < g ==> P(f) < P(g) , f,geA(n). 

The co-idempotence axiom (v) in Definition [T] was introduced by Rohwer in 
|13j . where it is also shown that it is an essential requirement for operators 
extracting signal from a sequence. 

The LULU theory was developed for sequences, that is, the case O = Z. 
Given a bi-infinite sequence £; = (S,i)iez and n G N the basic LULU operators 
L n and U n are defined as follows 

(Ln£)i = max{min{^_ n , minfe, & +n }}, i G Z. (1) 
(UnOi = min{max{£;_ n , ...,&}, ...,max{^, .. .,&+„}}, i G Z. (2) 

It is shown in [TS] that for every n G N the operators L n and U n as well 
as their compositions are syntone separators. Hence they are an appropriate 
tool for signal extraction. Furthermore, these operators form the so called 
strong LULU semi- group. This a four element semi-group with respect to 
composition, see Table 1, which is fully ordered with respect to the usual 
point-wise defined order 

p < Q P(f) < Q(f), f G A(Q). (3) 

We have 

L n <U n o L n < L n oU n < U n . (4) 

Let us recall that, according to the well known theorem of Matheron [10] . 
in general, two ordered morphological operators generate a six element semi- 
group which is only partially ordered. 

The power of the LULU operators as separators is further demonstrated 
by their Total Variation Preservation property. Let BVCL) be the set of 
sequences with bounded variation, that is, 

BV(Z) = {£ G A(7L) : £ % - < oo}. 
Total Variation of a sequence £ G BV(Z) is given by TV(£) = Yl l& — 
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Table 1: LULU semi-group 



Definition 2 An operator P : BV(Z) — > BV(Z) is called total variation 
preserving i/ 

TU(0 = TV(P(0) + TV((id - P)(0) , ( G 5F(Z). (5) 
We should note that since TV is a semi-norm on BV(7*) we always have 
TV(£) < TV(P(0) + TV((id - P)(0). 

Hence, the significance of the equality ([5]) is that the decomposition / = 
A(f) + (id — A)(f) does not create additional total variation. In particular, 
this property is very important for the application of the LULU operators to 
discrete pulse decompositions of sequences. 

The aim of this paper is to generalize the LULU operators to functions on 
Z d in such a way that their essential properties are preserved. In Section 2 the 
definitions of the basic operators L n and U n on „4(Z d ) are derived by using a 
strengthened form of the morphological concept of connection. Then we show 
that indeed these operators replicate the properties of the LULU operators 
for sequence. More precisely, we prove that: (i) they are separators (Section 
2); (ii) their smoothing effect can be described in a similar way to the n- 
monotonicity of sequences (Section 3); (hi) they generate a four element fully 
ordered semi-group (Section 4). The developed theory can be applied to many 
problems of Image Analysis and it is the intention of the authors to research 
such applications in the future. However, as an illustration and demonstration 
of the power of this approach we apply the newly defined operators to deriving 
a total variation preserving discrete pulse decomposition of images. Noise 
removal and partial reconstructions are discussed in Section 6. 

2 The basic operators L n and U n . 

The definition of the operators L n and U n for sequences involves maxima and 
minima over sets of consecutive terms, thus, making an essential use of the 
fact that Z is totally ordered. Since d > 1, is only partially ordered the 
concept of 'consecutive' does not make sense in this setting. Instead, we use 
the morphological concept of set connection, |19j . 

Definition 3 Let B be an arbitrary non-empty set. A family C of subsets of 
B is called a connected class or a connection on B if 
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(ii) {x} G C for all x G B 

(Hi) for any family {Ci : i G C} C C 

p| q ^ ==► (J d e c 

iel iei 

This definition generalizes the topological concept of connectivity to arbitrary 
sets including discrete sets like TL d . If a set C belongs to a connection C then 
C is called connected. 

It is clear from Definition [3] that a connection on Z rf does not necessarily 
contain sets of every size. For example, {0} U {{x} : x G Z d } and 
{0} U {{x} : x G Z d } U {Z d } are connections on Z d but neither of them con- 
tain sets of finite size other than and 1. In the definition of the operators 
L n and U n we need sets of every size. We assume that the set Z d is equipped 
with a connection C which satisfies the following three conditions 

• Z d eC (6) 

• For any a G Z d , E a {C) G C whenever C G C (7) 

• If V C W, V, W G C, then there exists x G W \ V 

such that V U {x} G C (8) 

The aim of the conditions ©-([8]) is to define a connection which is sufficiently 
rich in connected sets. This is demonstrated by the following property, which 
is obtained via iterative application of the property ©: 

• Let V C W, V, W G C. For every k G N such that 
card(F) < k < card(iy) there exists S G C (9) 
such that V C S C VF and card(5) = fe. 

As usual, card(y) is the number of the elements in the set V, that is, the 
size of V. For V Q Z d we have card(V) G N U {0} U {oo}. Given a point 
x G 1j d and n G N we denote by Af n (x) the set of all connected sets of size 
n + 1, which contain point x, that is, 

AA n (a;) = G C : x G V, card(V) = n + 1}. (10) 

Now the operators L n and C/ n are defined on A(Z d ) as follows. 

Definition 4 lei / G -4(Z d ) and n G N. TTien 

L n (f)(x) = max min/(y), x G Z d , (11) 

f/ n (/)(x) = min max/(y), x G Z d . (12) 
VeM n (x) y€V 

Let us first see that Definition H] generalizes the definition of L n and U n 
for sequences. Suppose al = 1 and let C be the connection on Z generated by 
the pairs of consecutive numbers. Then all connected sets on Z are sequences 
of consecutive integers and for any i G Z we have 

= n, i— n+1, ...,«}, {i— n+l,i— n+2, ...,i+l}, {i,i+l, ...,i+n}} 

Hence for an arbitrary sequence £ considered as a function on Z the formulas 
(fTTI) and (TT2]) are reduced to ([I]) and ([2]), respectively. 
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Theorem 5 (Order Properties) 

a ) L n < id <U n 

b) f<g=>{ L n (f) < L n (g), U n (f) < U n (g) ) 

c) m < n 2 ( L ni > L„ 2 , U ni < U n2 ) 

Proof. We will only prove the inequalities involving L n since those involving 
U n are proved similarly. 

a) Let / G A{2, d ). For every x G Z d and V G N n (x) we have 

min/(y) < f(x). 

y£V 



Hence 



L n (f)(x) = max min f(y) < f(x), x G Z d . 
VeAf n (x) y&V 



Therefore, L n (f) < f, f G .A(Z d ), which implies L n < id. 

b) Let / < g. For any x £ Z d and V £ J\f n (x), we have min/(y) < ming(y). 

y&V y£V 

Therefore 

L n (f)(x) = max min/(y) < max ming(y) = L n (g)(x), x G Z d . 
VeA/"n(p) yev veA/n(p) yev- 

c) Let / G .A(Z d ). It follows from {TDJ that for every x G Z d and V G AA n2 (x) 
there exists a set G jV ni (x) such that W QV. Therefore 

min/(y) < min/(y) < max min/(y) = L ni (f)(x). 
yeV yew SeAf ni (x) y^S 

Hence 

L n 2 (f)(x) = max min/(y) < L ni (f)(x),x G 7L d . 
VeMn 2 (x) yeV 



Theorem 6 For any n G N the operators L n and U n are separators. 

Proof. We will only verify the conditions (i)-(v) in Definition [T] for L n since 
U n is dealt with in a similar manner. 

(i) Let a G Z d and / G A(Ij d ). Using the property ([7]), for every x G Z d we 
have 

7V n (x + a) = a+7V n (x) = {a + V : V G N n {x)} 

Therefore, 

E a {L n {f)){x) = L n (f)(x + a)= max min/(y) 

V£Af„(a:+a) s/GV 

= max min /(y) = max min/(y + a) 

VeAf n (x) yea+v VeM n {x)yeV 

= max mm E a ( f)(y), x G Z rf 

(ii) Let /, c G -4(Z d ), where c is a constant function with a value of 0. Then 
for every x G Z rf we have 

L n (/ + c)(s) = max min(/ + c)(y) = max mm(/(y) + 0) 

Vetf n (x)yeV v&N n (x)y&v 



max mm f(y) \ +8 = L n (f)(x) + c(x) 
V&N n (x) y&V 
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(iii) Let / G A(Z, d ) and a G R, a > 0. For every x £ Z d we have 



L n (af)(x) = max min(a/)(y) = a max min/(y) = aL n (f)(x). 

VeNn(x)qeV \V&Af n (x)q&V J 

(iv) The inequality 

is an immediate consequence of Theorem [5j Then it is sufficient to prove the 
inverse inequality. Let / G .4(Z d ) and x G We have 

L ri (L ri ( f))(x) = max min max min f(z). (13) 

But y eW £ M n (x) implies W G N n (y). Therefore for every W G M n (x) and 
y G W we have 

max min f(z) > min f (z). 
V&M n {y) zev z&w 

Using that the right hand side is independent of y we further obtain 

min max min > min f (z), W G N n (x). 
yeWVeM n (y) zev z&w 



Then it follows from the representation (|13p that 

L n (L n (f))(x) > max min /(z) = L n (f)(x). 

W€Af„(x) z&W 

(v) The co-idempotence of the operator L n is equivalent to L n o (id — L n ) = 0. 
The inequality L n o(id — L n ) > is an easy consequence of Theorem^ Hence, 
for the co-idempotence of L n it remains to show that L n o (id — L n ) < 0. 
Assume the opposite. Namely, there exists a function / G A(Z d ) and x G 1i d 
such that (L n o (id — L n ))(f)(x) > 0. Using the definition of L n this inequality 
implies that there exists V G N n (x) such that for every y G V we have 
(id — L n )(f)(z) > 0, or equivalently 

/(y) > L n (f)(y), y G V. (14) 

Let z G V be such that f(z) = min/(f). Then for every y G V we have 

L n (/)(y) = max mm/(i) > mk/(t) > f(z). (15) 

Taking y = z in (|14|) and (|15|) we obtain a contradiction which completes the 
proof. ■ 



3 The operators L n and U n as smoothers 

Similar to their counterparts for sequences the operators L n and U n defined in 
Section [5] smooth the input function by removing sharp peaks (the application 
of L n ) and deep pits (the application of U n ). The smoothing effect of these 
operations is made more precise by using the concepts of a local maximum 
set and a local minimum set given below. 
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Definition 7 Let V E C. A point x is called adjacent to V ifVU {x} G C. 
The set of all points adjacent to V is denoted by adj(V), that is, 



adj(F) = {x E Z d : V U {x} G C}. 

An equivalent formulation of the property (jHJ) of the connection C is as 
follows: 

V,W EC, W C y =^ adj(W) n V / 0. (16) 

Definition 8 ^4 connected subset V of *Z d is called a local maximum set 

offeA(Z d )tf 

max f(y) < min fix). 

Similarly V is a local minimum set if 

min f(y) > max /fx). 
3/Gadj(V) xev 

The next four theorems deal with different aspects of the application of 
L n and U n to functions in A(% d ). Their cumulative effect will be discussed 
at the end of the section. All theorems contain statements a) and b). Due to 
the similarity we present only the proofs of a). 

Theorem 9 Let f G A(Z d ) and x G 7L d . Then we have 

a) L n (f)(x) < f(x) if and only if there exists a local maximum set V such 
that x G V and card(F) < n; 

b) U n (f)(x) > f(x) if and only if there exists local minimum set V such that 
x G V and card(F) < n. 

Proof, a) Implication to the left. Suppose that there exists a local maximum 
set V G ftfk(x), k < n. Consider an arbitrary W G M n (x) and let S = W n V. 
Then, since the size of W is larger than the size of S we have W \ S ^ 0. 
Furthermore, by (fT6l) we have adj(5) H W ^ 0. Let z G adj(5) n W. Since 
adj(5) HW CW\S = W\V, we have that z £ V but z G adj(F). Then 
using also that V is a local maximum set we obtain 

min f(y) < f(z) < min/(t) < f(x). 

Since the set W G M n (p) is arbitrary, this inequality implies that L n (f)(x) < 
/(*)■ 

Implication to the right. Suppose L n (f)(x) < f(x). Let V be the largest (in 
terms of C) connected set containing x such that 

f(y) > f(x), yeV. (17) 

The set V is obviously unique and can be constructed as V = j x (Y), where j x 
is the morphological point connected opening generated by x, see [19] or [5D], 
and Y = {y G Z d : f(y) > f{x)}. We have f(z) < f(x), z G adj(F), because 
otherwise ()1T|) is satisfied on the larger connected set {z} D V. Therefore 

max f(z)< f(x) = min/(y). 
2Gadj(V) ydV 
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Hence V is a local maximum set. 

Assume that card(V) > n. It follows from (|1U|) that there exists W G 
M n {x) such that W CV. Then 

L n(f)(x) = max min/(y) > min /(y) > min/(y) = f(x). 

V&N n {x) y£V y€W y£V 

This contradicts the assumption L n (f)(x) < f(x). Therefore, card(y) < n. 



Theorem 10 Let f G A{Z d ). Then 

a) the size of any local maximum set of the function L n (f) is larger than n; 

b) the size of any local minimum set of the function U n (f) is larger than n. 

Proof, a) Assume the opposite, that is, there exists a local maximum set V 
of L n (f) such that card(cf) < n. By Theorem [9] we have that 

L n {L n {f))(x) < L n (f)(x), xeV. 

Since L n is idempotent, see Theorem [61 this implies the impossible inequality 
L n (f)( x ) < L n (f)(x), which completes the proof. ■ 

Theorem 11 Let V € C and let x G adj(V). 

a) If f{x) < min/(y) then L n (f)(x) < min L n (f)(y); 

yev yev 

b) Iff(x) > max/0/) then U n {f){x) > max U n {f){y). 

y&V yeV 

Proof, a) For any W G M n (x) the set W U V is connected and of size 
larger than n + 1. Therefore, by (fT0|) . for every y G V there exists S y G M n {y) 
such that S y C WU V. Then, using also the given inequality, for every y G V 
and W G M n {q) we have 

m \%f(z) = min f{z) < min f{z) < L n {f){y). 



Hence 



Ln{f){x) = max min if(z) < minL„(/)(y). 

WeN n {x) zeW yeV 



Theorem 12 Let f G A(Z d ) and V G C. 

a) If V is a local minimum set of L n (f) then there exists a local minimum set 
W of f such that W CV. 

b) If V is a local maximum set of U n (f) then there exists a local maximum 
set W of f such that W C V. 

Proof, a) Let V be a local minimum set of L n {f). Then 

min f(y) > min L n (f)(y) > L n (f)(x) V x G V. 

yeadj(V) 2/eadj(V) 

Let q G adj(V) be such that f(q) = min f(y) and let 

yeadj(v) 

Y = {y G V : f(y) < f(q)}. 
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An easy application of Theorem [IT] shows that 7^0. Let t € Y and let W be 
the largest (with respect to inclusion) connected subset of Y which contains t. 
As in the proof of Theorem [9] the set W can be obtained through W = 7t(^ r ). 
For every z £ adj(W) we have f(z) > f(q) > max yg jy f(y). Therefore W is a 
local minimum set of /. ■ 

Theorems [§HT2"1 provide the following characterization of the effect of the 
operators L n and U n of a function / € A(Z d ): 

• The application of L n (U n ) removes local maximum (minimum) sets of 
size smaller or equal to n. 

• The operator L n (U n ) does not affect the local minimum (maximum) 
sets in the sense that such sets may be affected only as a result of the 
removal of local maximum (minimum) sets. However, no new local min- 
imum sets are created where there were none. This does not exclude the 
possibility that the action of L n (U n ) may enlarge existing local max- 
imum (minimum) sets or join two or more local maximum (minimum) 
sets of / into one local maximum (minimum) set of L n (f) (U n (f)). 

• L n (f) = f (U n (f) = f) if and only if / does not have local maximum 
(minimum) sets of size n or less; 

Furthermore, as an immediate consequence of Theorem [10] and Theorem 
[12] we obtain the following corollary. 

Corollary 13 For every f G A(Z d ) the functions (L n o U n ){f) and (U n o 
Ln)(f) have neither local maximum sets nor local minimum sets of size n or 
less. Furthermore, 



if and only if f does not have local maximum sets or local minimum sets of 
size less than or equal to n. 

We should remark that in the one dimensional setting, the sequences with- 
out local maximum sets or local minimum sets of size less than or equal to 
n are exactly the so-called n- monotone sequences. Hence Corollary [13] gener- 
alizes the respective results in the LULU theory of sequences, [131 Theorem 



In this section we consider the operators L n , U n and their compositions. The 
main result is that L n , U n , L n olI n and U n oL n form a semi-group with respect 
to composition with a composition table as given in Table 1. Furthermore, the 
semi-group is totaly ordered as in (|3J) with respect to the point-wise defined 
partial order ([3]). 

Theorem 14 The operators L n o U n and U n o L n are idempotent, that is, 



(L n o U n ){f) = {U n oL n ){f) = f 



3.3]. 



4 The LULU semi-group 



L n o U n ° L n o JJ n = L n O Uj 

U n o L n a U n o L n = U n ° L, 



'n 



(18) 
(19) 
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Proof. Using the order properties in Theorem [5] and the idempotence of L 
and U n , see Theorem O we have 



L n o U n o L n o U n < L n o U n o id o U n = L n o U n o U n = L n o U, 
L n oU n o L n oU n > L n oido L n oU n = L n o L n oU n = L n a U, 



n 



n 



which implies (fl8j) . The equality (fl9j) is proved similarly. ■ 



Theorem 15 For any neNw have 



L n o U n o L n = U n o L n . 



(20) 



Proof. It follows from Theorem [5] that 



L n o U n o L n < id o U n o L n = U n o L n . 



(21) 



Assume that ()20p is violated. In view of ()2ip . this means that there exists 
/ 6 A{1 d ) and zeZ d such that 



It follows from Theorem that there exists k < n and V € A4(z) such that V 
is a local maximum set for U n (L n (f))(z). Then, by Theorem 1121 there exists 
W C V such that is a local maximum set of the function L n (f). We have 
card(lU) < k < n. However, L n (f) does not have any local maximum sets 
of size less than or equal to n, see Theorem HOi This contradiction completes 
the proof. ■ 

As in the case of sequences, the key result for the set 



to be closed under composition is the equality in Theorem 1151 Now one can 
easily derive the rest of the formulas for the compositions of the operators in 
this set. The composition table is indeed as given in Table 1. Furthermore, 
Theorem 1151 implies the total order on the set (|22H as in (j3j). Indeed, we have 

L n = idoL n < U n oL n = L n oU n oL n < L n oU n o id = L n oU n < idoU n = U n 

Therefore, the operators L n and U n for functions on Z d generate via composi- 
tion a semi-group with exactly the same algebraic and order structure as the 
semi-group generated by the operators L n and U n for sequences. 

5 Discrete pulse transform of images 

In this section we apply the LULU operators defined and investigated in the 
preceding sections to derive a discrete pulse decomposition of images. A 
grayscale image is given through a function / on a rectangular domain Slc2 2 , 
the value of / being the luminosity at the respective pixel. For the theoretical 
study it is more convenient to assume that the functions are defined on the 
whole space Z 2 . To this end one can, for example, define / on the set 1? \ 
as a constant, e.g. 0. Hence we consider the set A(Ij 2 ). 



L n (U n (L n (f)))(z) < U n (L n (f))(z). 



{L n , U n , L n o U n , U n o L n } 



(22) 
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Figure 1: Neighbors of 



Appropriate connections for images are defined through a relation r on Z 2 
reflecting what we consider neighbors of a pixel in the given context. Figure 
f gives some examples of the the neighbors of the pixel (i,j). 

We call a set CC| 2 connected if for any two pixels p,q £ C there exists 
a set of pixels {pi,P2, ■■■,Pk} Q C such that each pixel is neighbor to the next 
one, p is neighbor to p\ and p^ is neighbor to q. We assume that the neighbor 
relation r on Z 2 is such that 

• r is reflexive, symmetric and shift invariant (23) 

• ((i,j), (i ± G r and ((», j), (t, j ± 1)) G r, for all i, j G Z. (24) 



The conditions (|23|) - (p4|) ensure that the set of connected set C defined through 
this relation is a connection in terms of Definition [3] and satisfies the condi- 
tions Q-dH]). Hence we can apply the operators L n and U n discussed in the 
preceding sections to functions on Z 2 . Similar to the case of sequences we 
obtain a decomposition of a function / G ACL 2 ) by applying iteratively the 
operators L n ,U n with n increasing from 1 to oo. This can be done in dif- 
ferent ways depending on sequencing of the L n and U n . Since this section is 
intended as a demonstration rather than presenting a comprehensive discrete 
pulse transform theory, we will take one particular case when U n follows L n . 
Define the operators F n , n G N, by F\ = U\ o L\ and F n = U n o L n o F n _i. 
Then for any / G ^4(Z 2 ) and m > 1 we have 

f = {id- U x oL x )(f) + ({id - U 2 oL 2 )oF 1 )(f) + ((id - U 3 oL 3 )oF 2 )(f) 

+ ... + ((id - U m oL m )oF m ^)(f) + F m (f) (25) 

Definition 16 A function (ft G »4(Z 2 ) is called a pulse if there exist a con- 
nected set V and a real number a such that 

, . _ J a if x £ V 

^ x >-\ o if xez 2 \v. 

The set V is called support of the pulse (j) and is denoted by supp(</>) . 

Figure 2 gives an example of a pulse. It should be remarked that the 
support of a pulse may generally have any shape, the only restriction being 
that it is connected. 

The usefulness of the representation (|25p of a function / G >4(Z 2 ) is in the 
fact that all terms are sums of pulses as stated in the next theorem. 
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Figure 2: Pulse 



Theorem 17 Let f G A{7?). 

a) For everyn G N the function {{id — U n oL n )oF n _i{f) is a sum of discrete 
pulses with disjoint support, that is, there exist j{n) G N and discrete 
pulses 4> ns , s = 1, ...,7(n), such that 

7(n) 

{{id-U n oL n )oF n ^ l ){f) = Y,<i>ns (26) 

8=1 

and 

supp(0 risi ) n supp((/> riS2 ) = for s 1 ^ s 2 . (27) 

6j iei ni,ri2, s±, s 2 G N be such that n\ < n 2 , 1 < si < 7(^1) and 1 < S2 < 
7(712). TTien 

supp(^ niSl ) n supp(0 n2S2 ) / => supp(0 niSl ) C supp(0 n2S2 ) (28) 

Proof, a) Denote g = F„_i(/). We have 

((id - C4 o L n ) o F ft _i)(/) = (id - L n )(g) + (id - U n )(L n (g)), (29) 

where the first term in the sum on the right hand side is nonnegative while 
the second one is nonpositive. Let x G I? be such that ((id — L n ){g) > 0. It 
follows from Theorem that there exists a local maximum set V of g such 
that x £ V and card(F) < n. Since g = (?7 n _i o L n -i){F n - 2 {f)) does not have 
local maximum set of size smaller than n, see Corollary 1131 this implies that 
card(y) = n and that g is a constant on 1/. Furthermore, {{id — L n ){g){y) = 
for y € adj(V). Indeed, if ((id — L n ){g){y) > for some y G adj(V), then 
y belongs to a local maximum set W of g and card(VF) < n. However, any 
maximum set containing y must contain V as well which implies card(lF) > 
n + 1, a contradiction. In this way we obtain that the support of (id — L n ){g) 
is a union of disjoint connected sets of size n, that is, 

supp((id - L n ){g)) = V 1 UV 2 U ... U V 1l(n) , 
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where V s G C, card(V s ) = n, s = 1, ...,7i(n) and V Sl fl U S2 = for si 7^ 82- 
Furthermore, (id — L n )(g) is a constant on each set V^. If (id — L n )(g)(x) = a s 
for x G V s , then 

71 (n) 

(id-L n )(g) =Y,(f>ns, (30) 

s=l 

where 

, . f a s if x £ V s 

<Pris(x) = 



if x G Z 2 \ V s 
Applying the same approach to the second term in (|29p we obtain 

supp((id - L n )(g)) = W 1 U W 2 U ... U Ty 72(n) , 

where W s G C, card(Ws) = n, s = 1, ...,72(71), W Sl n W S2 = for si / S2 and 

7(n) 

(id -t/,0 (£„($)) = ^ <^> ( 31 ) 

s=7l(n)+l 

where 7(71) = 7i(n)+7 2 (n) and supp(0 ns ) = W s _ 7l(n) , s = 7i(n) + l, ...,7(n). 
Note that 4> ns , s = l,...,7i(n), are upward (positive) pulses while 4> ns , s = 
71 (n) + 1, ...,7(71) are downward (negative) pulses. We obtain (f2o| by sub- 
stituting ([30]) and (|3l]) in j29]). It only remains to show that V S1 n W S2 = 
for all si = l,...,7i(n), s 2 = 1, ...,72(71). Indeed, assume that V Sl H W S2 7^ 0. 
From the definition of the operator L n , there exists y £ adj(V^j) such that 
L n (g)(x) = g(y) for x G n {y}. Therefore, V Sl n {y} C W S2 , which implies 
that card(W S2 ) > n + 1. Since the size of each one of the sets Wi, ..-W^t n ) is 
n, none of them intersects V Sl . 

b) Let supp(0 nisi ) l~l supp(</) n2S2 ) 7^ 0. It follows from the construction 
of ([26]) derived in a) that the functions F n (f) and L n+ i(F n (f)), n > n±, are 
constants on the set supp(0 nisi ). Furthermore, the set supp(4> n2S2 ) is a local 
maximum set of F n2 ^i(f) or a local minimum set of L n2 (F n2 _i(f)). From 
the definition of local maximum set and local minimum set it follows that 
supp(0 niSl ) C supp(</> 

Using Theorem [TTJ the equality (|25p can be written in the form 

k=l s=l 

If the function / has finite support, e.g. as in the case of images, then F m (f) 
is a constant for a sufficiently large m. Then we have 

m 7( fc ) 

f = Y.Y.^ + c > ( 33 ) 

k=l s=l 

where c = F m (f)(x), x G 1? . The equality ([33]) is a discrete pulse decom- 
position of /, where the pulses have the properties (f2"T|) - (f2"gj) . It is generally 
accepted that an image is perceived through the contrast, that is, the differ- 
ence in the luminosity of neighbor pixels. The discrete pulse transform (|33|) 
extracts all such differences as single pulses. Hence, (f33l) can be a useful tool 
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in the analysis of images. Since the information in an image is in the con- 
trast, the total variation of the luminosity function is an important measure of 
the quantity of this information. Image recovery and noise removal via total 
variation minimization are discussed in [3] and [TB]. It should be noted that 
there are several definition of total variation of functions of multi-dimensional 
argument (Arzel variation, Vitali variation, Pierpont variation, Hardy varia- 
tion, etc.). In the applications cited above the total variation is the L 1 norm 
of a vector norm of the gradient of the function. Here we consider a discrete 
analogue of this concept. 

Definition 18 Let f G A{I?). If 

oo oo 

E E (i/c* + ^ - + \f&j + !) - f&M < 00 ( 34 ) 

i=— 00 j=—oo 

then f is said to be of bounded variation. The sum on the left side on the 
inequality {3$ is called total variation of f and is denoted by TV(f). 

As mentioned in the introduction, the LULU operators for sequences are 
total variation preserving. We show here that their two-dimensional counter- 
parts considered in this section have the same property with respect to the 
total variation as given in Definition 1181 

Let us denote by BV(Z 2 ) the set of all functions of bounded variation in 
A(T?). Clearly, all functions of finite support are in BV(Z 2 ). In particular, 
the luminosity functions of images are in BV(Z 2 ). The total variation given 
in Definition [18] is a semi-norm on BV(Z 2 ). In particular, this implies that 

TV(f + g)<TV(f) + TV(g). (35) 

The total preservation property is defined for operators on BV{1?) as in 
Definition O where Z is replaced by 1? . 

Theorem 19 The operators L n , U n , n=l,2,..., and their compositions are 
all total variation preserving. 

Proof. Let / G BV{I?) and (i,j) G 1? . We will show that 

\f(i,j)-f(i + lj)\ = \L n {f){i,j)-L n (f){i + l,j)\ 

+ I (id - L n )(f)(i,j) - (id - L n )(f)(i + l,j)| (36) 

Case 1. L n (f)(i,j) < f(i,j). In follows from Theorem [9] that there exists 
a local maximum set V such that G V and card(^) < n. Without 

loss of generality we may assume that V is the largest set with the said 
properties. Then L n (f)(x) = f(z), x G V, where z G adj(V) is such that 
f(z) = max (f)(y). Since (i + 1, j) is a neighbor to (i,j), see ([Ml) , we have 

j/Gadj(V) 

either (i + 1, j) G V or (i + G adj(V). 

Case 1.1 (i + G V. Then L n (f)(i,j) - L n (f)(i + 1, j) = f(z) - f(z) = 
and (|B"6"]) trivially holds. 

Case 1.2 (i + 1, j) G adj(V). Then (i + cannot be element of a local 
maximum set of size smaller or equal to n. Therefore, L n (f)(i + = 
f(i + < f{z) = L n (f)(i,j), which implies ®. 
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Case 2. L n (f)(i,j) = f(i,j). If L n (f)(i + = f(i + 1, j) the equality ® 
trivially holds. If L n (f)(i + 1, j) < f(i+l,j), then we obtain (f3f)|) by repeating 
the argument in Case 1.2 where the points and (i + 1, j) change places. 
Similarly to (|36|) we prove that 

|/(*,j)-/(*,j + i)l = IM/)(ii)-^n(/)(i,i + i)| 

+ | (id - L n )(f)(i,j) - (id - L n )(f)(i,j + 1)| 

Then by Definition [TK] we have 

TV(f) = TV(L n (f)) + TV ({id - L n )(f)). 

The total variation preserving property of U n is proved in a similar way. 

In order to complete the proof we show that the composition A o B of 
any two total variation preserving operators A and B on BV(7 J 2 ) is also total 
variation preserving. Using the total variation preserving property of A and 
B and (|35p we have 

TV(f) = TV(B(f))+TV((id-B)(f)) 

= TV(A(B(f))) + TV((id - A)(B(f))) + TV((id - B)(f)) 

> TV((A o £)(/)) + TV(((id - A) o B + id- B)(f)) 

= TV((AoB)(f)) + TV((id-AoB)(f)). 

From (ESD we also obtain TF(/) < TV ((A o B)(/)) + 7V((id - Ao 
Therefore TV(f) = TV((A o B)(f)) + TV {(id - Ao B)(f)). m 

Let function / G A(T?) have finite support, e.g. as in the case of images. 
Then / G BV(7?). Using Theorem [T^] the discrete pulse decomposition (|33|) 
is total variation preserving in the sense that 

Tv(f) = Y J Y. TV ^)- ( 37 ) 

k=l s=l 

We should remark that representing a function as a sum of pulses can be done 
in many different ways. However, in general, such decompositions increase 
the total variation, that is, we might have strict inequality in (|37p instead of 
equality. The equality in (I37p means that no additional total variation, or 
noise, is created via the decomposition. 

6 Partial reconstructions and noise removal 

Possibly the simplest application of the discrete pulse decomposition ([331) 
is via partial reconstructions of images. This can be used for example in 
removing noise or extracting features of interest. Random noise has very 
distinctive discrete pulse decomposition characterized by fast decrease of the 
number of pulses with the increase of the pulse size. The number of pulses 
in decomposition ([33p versus their size for a 300 x 400 image of random noise 
(the luminosity at each pixel is an independent uniformly distributed random 
variable) is plotted on Figure O It is apparent that random noise seldom 
generates pulses of large size. In fact, 90% of the pulses represented on Figure 
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Pulse Size Pulse Size (1 00 - 39000) 

Figure 3: Pulse distribution of random noise 




Figure 4: A sea image 



[3] are of size less than or equal to 20 and only about 2% have size greater than 
100. Hence by removing the pulse of small support we remove large portion of 
any impulsive noise. Figure [5] gives in the same format the pulse distribution 
of the image on Figure [U A large portion of the pulses has small support 
but, unlike Figure we have also significant number of pulses with relatively 
larger support. Partial reconstruction of the image by using pulses of selected 
sizes is given on Figure El We can consider (a) as removing of impulsive noise, 
(b) as extraction of small features and (c) as extraction of large features. 
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(a) 




Figure 6: Partial reconstructions of the sea image: (a) Pulses of size larger than 20; 
(b) Pulses of size from 21 to 400; (c) Pulses of size from 30000 to 50000. 
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